THE LAW OF THE ITERATED LOGARITHM FOR ADDITIVE 
FUNCTIONALS OF MARKOV CHAINS 

YU MIAO AND GUANGYU YANG 

Abstract. In the paper, the law of the iterated logarithm for additive functionals 
of Markov chains is obtained under some weak conditions, which are weaker than 
the conditions of invariance principle of additive functionals of Markov chains in 
M. Maxwell and M. Woodroofe Q (2000). The main technique is the martingale 
argument and the theory of fractional coboundarics. 



1. Introduction 

Let X , Xi, X 2 , . . . denote an ergodic stationary Markov chain with values in a 
measurable space (X,B), transition function Q, and stationary initial distribution 
7r. Further, let L 2 (ir) denote the space of (equivalence classes of) square integrable 
functions g : X — > K, for which ||g|| 2 := j x g 2 dn < oo, and let Lq(7t) denote the set 
of g G L 2 (n) for which J x gdit = 0. Given g G Lq(it), for n > 1, let 

n 

S n = S n (g):=Y,gm- (1-1) 

i=l 

To describe more detailedly the model of additive functionals of above Markov chain, 
let Q denote both the conditional distribution of X± given X Q and the operator defined 
by 



Qh(x) = / h(y)Q(x;dy) 
for a.e. x G X and all h G L 2 {ti). It is easy to see that Q is a contraction. Let 

n-l 

V n h = Q'h 



k=0 



for h G L 2 (ir) and n > 1. Then each V n is a bounded linear operator. It is obviously 
that V n g(x) = E^fo)!^ = x] for a.e. x (vr). For model (O]) . M. Maxwell and M. 
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Woodroofe (2000) gave the central limit theorems under the following conditions: 

oo 

geL 2 Q (ir), $>- 3 / 2 ||Ks|| < oo, (1.2) 

n=l 

where || ■ || denotes the norm in L 2 (ir). 

It is well known that the law of the iterated logarithm (in short LIL) is closely 
related to the central limit theorem (in short CLT) in some sense. There are several 
approaches to these problems. If the chain is Harris recurrent, then the problems may 
be reduced to the independent case in a certain sense, see S.P. Meyn and R.L. Tweedie 
[§[ (1993). If there is a solution to Poisson's equation, h = g + Qh, then the LIL and 
CLT problem may be reduced to the martingale case, see also M.I. Gordin and B.A. 
Lifsic |U (1978) and S.P. Meyn and R.L. Tweedie (1993). R.N. Bhattacharya 
(1982) obtained CLT and LIL for ergodic stationary Markov process by discussion 
for infinitesimal generator. L.M. Wu Tl[ (1999) extended the forward-backward 



martingale decomposition of Meyer-Zheng-Lyons's type from the symmetric case to 
the general stationary situation and gave Strassen's strong invariance principle. 

Our goal, in this paper, is to consider the problem that S n satisfies the LIL under 
some proper conditions. We will explore some extensions of the Poisson's equation ap- 
proach, along the lines of C. Kipnis and S.R.S. Varadhan (1986), and M. Maxwell 
and M. Woodroofe (2000), to the cases where a solution is not required. We obtain 
the LIL for additive functionals of Markov chains in Section 2, where mainly depend- 
ing on the LIL of martingale and the theory of fractional coboundaries developed by 
Y. Derriennic and M. Lin [3| (2001). In Section 3, we will give two examples, whose 
central limit theorems and invariance principles are discussed in M. Maxwell and M. 
Woodroofe (2000), to illustrate our results. 

2. Main results 
For e > 0, let h £ be the solution to the equation (1 + e)h = Qh + g, 

Q n - l g ^ v n g 



(l +£ )n - 6 2^ n +£ )n+l- V- l > 



n=L ' n=l 



Let 7Ti be the joint distribution of Xq and X±, so that ni(dxo; dx\) = Q(xo;dxi) x 
ir(dxo); denote the norm in L 2 (tti) by || ■ l^; and let 

H e (x ,xi) = h E (xi) -Qh £ (x ) 

for Xq, X\ G X. Then for any e > 0, H £ is in L 2 (tti); the norm of H £ is ||-ffe||i = 
\\h £ \\ 2 — \\Qh £ \\ 2 ; and J x H £ (x , Xi)Q(x ] dxi) = for a.e. x (n). 
Now, let us give a few more definitions. For e > 0, let 

M n (e) = H E {X Q ,X X ) + ■■■ + H £ (X n _ u X n ) 

and 

R n (e) = Qh £ (X )-Qh £ (X n ), 
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hence, by simple calculation, 

S n (g) = M n (e) + eS n (h £ ) + R n (e). (2.2) 

For any fixed e, M n (e) is a square integrable martingale, where the martingale dif- 
ference sequences is stationary ergodic. 

Before our main results, we need mention the following lemmas. 

Lemma 2.1. ( See M. Maxwell and M. Woodroofe 0/ (2000) ) 

: (Rl) If mE) holds and \\V n g\\ = 0(n a ) for some a > 0, then \\h e \\ = 0(e~ a ) 
as e — > 0. 

(R2) For0<e,5< oo, \\H e - H 5 \\\ < (e + S)[\\h e \\ 2 + \\h s \\ 2 ]. 
(R3i) If II 1.2]) holds, then H = lim e j if e exists in L 2 (tti). 
(R4) If (ED holds, then 

S n = M n + R n , (2.3) 

where Mi, M2, ■ ■ ■ and Ri, R2, . . . have strictly stationary increments, Mi, M2, ■ ■ 
is a square integrable martingale, and E(-R^) = o(n) as n — »• 00. 

Recall that T is a Dunford-Schwartz (DS) operator on L 1 of a probability space: 
if T is a contraction of L 1 such that HT/Hoo < ||/||oo for every / G L°°. If 9 is a 
measure preserving transformation in a probability space (Q, E, /i), then the operator 
T f = f o is a DS operator on L 1 ^). More generally, any Markov operator P with 
an invariant probability yields a positive DS operator. 

Lemma 2.2. ( See Y. Derriennic and M. Lin |1/ (2001) ) 

: (LI) Let T be a contraction in a Banach space X, and let < (3 < 1. If 
1 n 

SU P || 1 _g T k y\\ < 00, then y E (I — T) a X for every < a < (3. 
n n fc=i 

: (L2) Let T is a DS operator in L 1 (/i) 0/ a probability space, and fix 1 < p < 00, 
with dualq = p/(p-l). Let0<a<l, and f G (I-T) a L p . Ifa>l- l = -, 

^ n— 1 

i/ien — y- Vt 1 / -> a.e. 

k=0 



Lemma 2.3. ( See W.F. Stout flu] (1970) ) Let (Y^i > 1) be a stationary ergodic 
stochastic sequence with E[Yi|Yi, Y2, • • ■ , ^i-i] = a.e. for all i > 2 and KY 2 = 1. 



Then 



spn y 

hmsup — — j — = 1, a.e. 

(2n log iogn) 1 ^ 



n— >oo 

"2 



Theorem 2.4. Let g G Lq(7t) and \\V n g\\ = 0{n a ) for some a < 1/2. Then, we have 

"^ P (2nlogtgn)V2 = ll g ll- «* < 2 - 4 > 
where H is defined as Lemma \2J\ (R3). 
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Proof. At first, we notice that, by Lemma \2. II (-R4), M n is a square integrable mar- 
tingale with strictly stationary increments and, by Lemma 12.31 M n satisfies the law 
of the iterated logarithm, i.e. 

limsup Mn — 7372 = H-Hlli, a - e - ( 2 - 5 ) 
n^oo (2nloglogn) 1 /^ 

where is due to the ergodic theorem, i.e. 

1 n 

lim - V H{Xi^Xi) 2 = \\H\\l a.e. 

n— >oo 77, ^— ' 

i=l 

Next we will consider i? n . For each n > 1, let 5j = 2~'\ k n be the unique integer k 
for which 2 k ~ l < n < 2 k and let e n = 2~ kn . Then, by (12. 2p and Lemma [27T1 (-R4). we 
have i? n = M n (e n ) - M n + e n S n (h £n ) + R n {£ n ) and, therefore, 

E(i^) < 4E[M n (e n )-M ri ] 2 + 44E[ > S n (/i £ J] 2 + 4E[ J R n (£„)] 2 

< 4n||^- J f7|| 2 + 4||/ i£ J| 2 + 8||/i £ J| 2 . (2.6) 

By Lemma I2TT1 (-R1). ||/i en || = 0{n a ) and by the definition of e n and Lemma I2TT1 (-R2) , 
there is a constant C for which 

oo oo 

n^-^iii< e n^-^-ji^^ e d r=°K" i/2 )' ( 2 - 7 ) 

Thus, we have E(i? 2 ) = 0(n 2a ). 

On X x X, define /(xo,xi) = g(xo) — H(xo,xi), then 

n— 1 n 

i? n = S B - M n = E^(^) " =^2f(X it X i+1 ). (2.8) 

i=l i=l 

For sequence x = (xi) ie ^ G X N , define F(x) = f(x ,xi) and let 9 is the shift map 
on X® which is a contraction on the space L 2 (tti). Then, we have 

n-l 

F G L 2 {jii) and R n = ^Fo6 k . (2.9) 

k=0 

From the fact E(i? 2 ) = 0(n 2a ), there exists a constant 1/2 < j3 < 1 — a, such that 

j n— 1 

sup 



■it 



^ n— 1 

^E Fo ^' <o °- ( 2 - 10 ) 



n x-P 

k=0 



Since LemmaO(il) and a < 1/2, we have F G (/ - O^L 2 ^), where 77 G (1/2, 1 — 
a). By Lemma [2.21 (L2), we have 

—rj^Rn — > 0, 7Ti - a.e. 
Thus the result of the theorem holds by the fact, SVt = + R n - D 
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Corollary 2.5. If g G L 2 (n), and either 

oo 

53 A;*" 1 / 2 ||Q*^|| <oo (2.11) 

fc=l 

or 

oo 

5> 5 ||Q fc a|| 2 <oo, (2.12) 

k=l 

for some 5 > 0, then \2.J$ holds. 

Proof. By Kronecker's lemma and V n g = Y^k=o Q k 9i (12-lip means that 

n 

n^ 1/2 \\V n g\\<n 5 ^ 2 Y,\\Q k 9\\^0, as n - oo. 

fc=i 

It is obvious that, (12.121) implies (12. lip . Form Theorem 12.41 the corollary holds. □ 

Remarks 2.6. If g G I%(tt), for some p > 2, then fl2~TT]) or (12321) are satisfied, M. 
Maxwell and M. Woodroofe (2000) gave an invariance principle of 

B n {t) = -=S [n£ \, < t < 1, 

and B n (l) = B n (l— ) for n > 1, where \x~\ denotes the least integer that is greater 
than x. 



3. Some applications 

In this section, we will give two examples to show that they satisfy the law of the 
iterated logarithm under some weakly dependent conditions. Here, the processes do 
not have recurrent points and are not strongly mixing. In fact, the two examples 
have been studied in M. Maxwell and M. Woodroofe [7| (2000) and we should thank 
their ideas and results. 

Example 1. ( Bernoulli shifts )Let k = 0, ±1, ±2, ... be i.i.d. random variables 
that take the values and 1 with probability 1/2 each and let 

oo 

X n = ]T(l/2) fc+1 £ n „ fc 

k=l 

for n = 0, 1, 2, . . .. Then {X n , n > 0}, is an ergodic stationary Markov chain taking 
values in I = [0,1]. The transition function is defined by Q(x; {x/2}) = 1/2 = 
Q(x; {1 +x}/2) for x G [0, 1] and the stationary initial distribution is the restriction, 
A say, of Lebesgue measure to I. In this case, L 2 (A) is a familiar space, and it is easy 
to relate the conditions in Theorem 12.41 to regularity properties of g. 
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Proposition 3 in M. Maxwell and M. Woodroofe Q (2000) showed that if g G Lg(A) 
and 

f CW) - 9{v)\ 2 T^—^g 5 [j-^-Mxdy < oo (3.1) 

Jo Jo \ x ~ y\ \ x ~ y\ 

for some 5 > 0, then (I2.12p holds. For example, if 



g{x) = — sin ( —) , < x < 1, 

x a \x/ 



x" \x> 
where < a < 1/2, then (l2~T2j) holds. 

Example 2. ( Lebesgue shifts )Let C4, = 0, ±1, ±2, ... be i.i.d. random vari- 
ables that are uniformly distributed over / = [0, 1] and let 

X n = (■■■U n - 2 ,U n - U U n ), n>0. 

Then {X n , n > 0}, is a stationary Markov process taking values in X = I M , where 
M denote the non-positive integers. The stationary initial distribution it here is 
the countable product of copies of Lebesgue measure. Processes of the form g(X n ), 
n — 0,1,2, . . ., include a wide class of stationary sequences. 
Define measures T] on X x X by 

oo 

T}{B} = J>V x vr x A fc ){(x,y,*) : [(x,z), (y,z)] G £?} 

k=l 

for Borel set 5 C Xx X, where x and (x, z) denote the sequences x = (. . . , w_ 2 , «o) 
and (. . . , w_i, u , Zi, . . . , £&) and X k denotes Lebesgue measure on I k . 
M. Maxwell and M. Woodroofe Q (2000) showed that if g G Lg(7r) and 




[g(x)-g(y)} 2 Tl{dx,dy}<oo, (3.2) 



for some 5 > 0, then (12.121) holds. To illustrate the (13.21) . observe that any g G L^n) 
may be written in the form 

oo 

d( x ) = ^29k(u- k , . . .,u ), 

k=0 

where x = (. . . , w_ 2 , u ), g k : M fc+1 — > WL are measurable, f R gk(u_k, . . . , u )du_k = 
for a.e. (w-fc+i, . . . , uo), YlkLi 1 9k^ k+1 < 00 > an ^ denotes fc— dimensional 
Lebesgue measure. Then (12. 12[) holds if for some 6 > 0, 



oo „ 

J^k 1+S / 9 2 k d\ k+1 <oo. 
fc=i ^ 
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